tv stand
Bring the Apple, Not the Sofa: Impact of Irrelevant Context in Embodied AI Commands on VLA Models
Pugacheva, Daria, Moskalenko, Andrey, Shepelev, Denis, Kuznetsov, Andrey, Shakhuro, Vlad, Tutubalina, Elena
Vision Language Action (VLA) models are widely used in Embodied AI, enabling robots to interpret and execute language instructions. However, their robustness to natural language variability in real-world scenarios has not been thoroughly investigated. In this work, we present a novel systematic study of the robustness of state-of-the-art VLA models under linguistic perturbations. Specifically, we evaluate model performance under two types of instruction noise: (1) human-generated paraphrasing and (2) the addition of irrelevant context. We further categorize irrelevant contexts into two groups according to their length and their semantic and lexical proximity to robot commands. In this study, we observe consistent performance degradation as context size expands. We also demonstrate that the model can exhibit relative robustness to random context, with a performance drop within 10%, while semantically and lexically similar context of the same length can trigger a quality decline of around 50%. Human paraphrases of instructions lead to a drop of nearly 20%. To mitigate this, we propose an LLM-based filtering framework that extracts core commands from noisy inputs. Incorporating our filtering step allows models to recover up to 98.5% of their original performance under noisy conditions.
- Leisure & Entertainment (0.46)
- Information Technology (0.46)
- Information Technology > Artificial Intelligence > Robots (1.00)
- Information Technology > Artificial Intelligence > Representation & Reasoning (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.47)
How to build a streaming setup that fits your home – and your wallet
Upgrade your streaming setup with a new TV, mounts, TV stands, soundbars and backlighting. Upgrading your streaming setup may mean replacing your outdated TV, adding a soundbar so you can actually hear what's going on or finally mounting your TV so you can see it better. No matter what your budget is, we've lined up everything you need to give your streaming setup a facelift. There are options less than 300 all the way up to 2,000. And for those who want the latest and greatest tech, no matter how much it costs, we have options for you, too.
- Information Technology > Artificial Intelligence (0.49)
- Information Technology > Communications > Mobile (0.49)
12 Best Prime Day TV Deals (2023): OLED TVs, Soundbars, Speakers
Now is a great time to replace that old screen. Modern TVs are now brighter, have better contrast, and work better for gaming than ever before. This Prime Day we've found deals on some of our favorite TVs, soundbars, and 4K streaming devices. Whether you're gearing up to watch Lionel Messi in Major League Soccer or you're just trying to catch up on your favorite Marvel movies, these screens and accessories will be sure to satisfy. If you buy something using links in our stories, we may earn a commission.
- Information Technology > Hardware (0.51)
- Information Technology > Artificial Intelligence > Natural Language (0.31)